bench(sort): lower sample count for sort benchmarks by rluvaton · Pull Request #23539 · apache/datafusion

rluvaton · 2026-07-13T22:04:39Z

Which issue does this PR close?

N/A

Rationale for this change

the new sort benchmarks takes a long time

What changes are included in this PR?

reduce sample size for wide payload

Are these changes tested?

No

Are there any user-facing changes?

No

rluvaton · 2026-07-13T23:07:33Z

run benchmark sort

baseline:
  ref: FETCH_HEAD

adriangbot · 2026-07-13T23:10:32Z

🤖 Benchmark running (GKE) | trigger
Instance: c4a-highmem-16 (12 vCPU / 65 GiB) | Linux bench-c4963668222-1042-pgrpp 6.12.85+ #1 SMP Mon May 11 08:17:35 UTC 2026 aarch64 GNU/Linux

CPU Details (lscpu)

Architecture:                            aarch64
CPU op-mode(s):                          64-bit
Byte Order:                              Little Endian
CPU(s):                                  16
On-line CPU(s) list:                     0-15
Vendor ID:                               ARM
Model name:                              Neoverse-V2
Model:                                   1
Thread(s) per core:                      1
Core(s) per cluster:                     16
Socket(s):                               -
Cluster(s):                              1
Stepping:                                r0p1
BogoMIPS:                                2000.00
Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache:                               1 MiB (16 instances)
L1i cache:                               1 MiB (16 instances)
L2 cache:                                32 MiB (16 instances)
L3 cache:                                80 MiB (1 instance)
NUMA node(s):                            1
NUMA node0 CPU(s):                       0-15
Vulnerability Gather data sampling:      Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit:             Not affected
Vulnerability L1tf:                      Not affected
Vulnerability Mds:                       Not affected
Vulnerability Meltdown:                  Not affected
Vulnerability Mmio stale data:           Not affected
Vulnerability Reg file data sampling:    Not affected
Vulnerability Retbleed:                  Not affected
Vulnerability Spec rstack overflow:      Not affected
Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
Vulnerability Spectre v2:                Mitigation; CSV2, BHB
Vulnerability Srbds:                     Not affected
Vulnerability Tsa:                       Not affected
Vulnerability Tsx async abort:           Not affected
Vulnerability Vmscape:                   Not affected

Comparing lower-sample-count-sort (e335354) to FETCH_HEAD diff using: sort
Results will be posted here when complete

File an issue against this benchmark runner

adriangbot · 2026-07-14T01:08:08Z

Benchmark for this request hit the 7200s job deadline before finishing.

Benchmarks requested: sort

Kubernetes message

Job was active longer than specified deadline

File an issue against this benchmark runner

rluvaton · 2026-07-14T15:12:07Z

run benchmark sort

baseline:
  ref: without-extra-sort-benches

adriangbot · 2026-07-14T15:15:05Z

Benchmark for this request failed.

Last 20 lines of output:

Click to expand

Cloning into '/workspace/datafusion-branch'...
From https://github.com/apache/datafusion
 * [new ref]         refs/pull/23539/head -> lower-sample-count-sort
 * branch            main                 -> FETCH_HEAD
Switched to branch 'lower-sample-count-sort'
d0304b3ff5fc1ccc47106384437232d54c462d46
Cloning into '/workspace/datafusion-base'...
From https://github.com/apache/datafusion
 * branch            refs/pull/23539/head -> FETCH_HEAD
error: pathspec 'without-extra-sort-benches' did not match any file(s) known to git

File an issue against this benchmark runner

rluvaton · 2026-07-14T15:30:44Z

run benchmark sort

baseline:
  ref: origin/without-extra-sort-benches

adriangbot · 2026-07-14T15:33:31Z

Benchmark for this request failed.

Last 20 lines of output:

Click to expand

Cloning into '/workspace/datafusion-branch'...
From https://github.com/apache/datafusion
 * [new ref]         refs/pull/23539/head -> lower-sample-count-sort
 * branch            main                 -> FETCH_HEAD
Switched to branch 'lower-sample-count-sort'
d0304b3ff5fc1ccc47106384437232d54c462d46
Cloning into '/workspace/datafusion-base'...
From https://github.com/apache/datafusion
 * branch            refs/pull/23539/head -> FETCH_HEAD
error: pathspec 'origin/without-extra-sort-benches' did not match any file(s) known to git

File an issue against this benchmark runner

rluvaton · 2026-07-14T15:43:53Z

run benchmark sort

baseline:
  ref: FETCH_HEAD

adriangbot · 2026-07-14T15:46:57Z

🤖 Benchmark running (GKE) | trigger
Instance: c4a-highmem-16 (12 vCPU / 65 GiB) | Linux bench-c4971097207-1060-hdm9f 6.12.85+ #1 SMP Mon May 11 08:17:35 UTC 2026 aarch64 GNU/Linux

CPU Details (lscpu)

Architecture:                            aarch64
CPU op-mode(s):                          64-bit
Byte Order:                              Little Endian
CPU(s):                                  16
On-line CPU(s) list:                     0-15
Vendor ID:                               ARM
Model name:                              Neoverse-V2
Model:                                   1
Thread(s) per core:                      1
Core(s) per cluster:                     16
Socket(s):                               -
Cluster(s):                              1
Stepping:                                r0p1
BogoMIPS:                                2000.00
Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache:                               1 MiB (16 instances)
L1i cache:                               1 MiB (16 instances)
L2 cache:                                32 MiB (16 instances)
L3 cache:                                80 MiB (1 instance)
NUMA node(s):                            1
NUMA node0 CPU(s):                       0-15
Vulnerability Gather data sampling:      Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit:             Not affected
Vulnerability L1tf:                      Not affected
Vulnerability Mds:                       Not affected
Vulnerability Meltdown:                  Not affected
Vulnerability Mmio stale data:           Not affected
Vulnerability Reg file data sampling:    Not affected
Vulnerability Retbleed:                  Not affected
Vulnerability Spec rstack overflow:      Not affected
Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
Vulnerability Spectre v2:                Mitigation; CSV2, BHB
Vulnerability Srbds:                     Not affected
Vulnerability Tsa:                       Not affected
Vulnerability Tsx async abort:           Not affected
Vulnerability Vmscape:                   Not affected

Comparing lower-sample-count-sort (a61af43) to FETCH_HEAD diff using: sort
Results will be posted here when complete

File an issue against this benchmark runner

rluvaton · 2026-07-14T17:30:40Z

run benchmark sort

baseline:
  ref: a61af43a0a50a1e4f75d229865afd794977f244d

adriangbot · 2026-07-14T17:33:34Z

🤖 Benchmark running (GKE) | trigger
Instance: c4a-highmem-16 (12 vCPU / 65 GiB) | Linux bench-c4972113752-1061-hr7gv 6.12.85+ #1 SMP Mon May 11 08:17:35 UTC 2026 aarch64 GNU/Linux

CPU Details (lscpu)

Architecture:                            aarch64
CPU op-mode(s):                          64-bit
Byte Order:                              Little Endian
CPU(s):                                  16
On-line CPU(s) list:                     0-15
Vendor ID:                               ARM
Model name:                              Neoverse-V2
Model:                                   1
Thread(s) per core:                      1
Core(s) per cluster:                     16
Socket(s):                               -
Cluster(s):                              1
Stepping:                                r0p1
BogoMIPS:                                2000.00
Flags:                                   fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti
L1d cache:                               1 MiB (16 instances)
L1i cache:                               1 MiB (16 instances)
L2 cache:                                32 MiB (16 instances)
L3 cache:                                80 MiB (1 instance)
NUMA node(s):                            1
NUMA node0 CPU(s):                       0-15
Vulnerability Gather data sampling:      Not affected
Vulnerability Indirect target selection: Not affected
Vulnerability Itlb multihit:             Not affected
Vulnerability L1tf:                      Not affected
Vulnerability Mds:                       Not affected
Vulnerability Meltdown:                  Not affected
Vulnerability Mmio stale data:           Not affected
Vulnerability Reg file data sampling:    Not affected
Vulnerability Retbleed:                  Not affected
Vulnerability Spec rstack overflow:      Not affected
Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1:                Mitigation; __user pointer sanitization
Vulnerability Spectre v2:                Mitigation; CSV2, BHB
Vulnerability Srbds:                     Not affected
Vulnerability Tsa:                       Not affected
Vulnerability Tsx async abort:           Not affected
Vulnerability Vmscape:                   Not affected

Comparing lower-sample-count-sort (a61af43) to a61af43 diff using: sort
Results will be posted here when complete

File an issue against this benchmark runner

adriangbot · 2026-07-14T17:44:26Z

Benchmark for this request hit the 7200s job deadline before finishing.

Benchmarks requested: sort

Kubernetes message

Job was active longer than specified deadline

File an issue against this benchmark runner

adriangbot · 2026-07-14T19:31:14Z

Benchmark for this request hit the 7200s job deadline before finishing.

Benchmarks requested: sort

Kubernetes message

Job was active longer than specified deadline

File an issue against this benchmark runner

rluvaton added 2 commits July 13, 2026 16:47

remove all sort benches

2419404

try

5b1aa71

github-actions Bot added the core Core DataFusion crate label Jul 13, 2026

rluvaton added 3 commits July 14, 2026 17:37

reduce

cfc63e9

reduce

75f955c

Merge branch 'main' into lower-sample-count-sort

a61af43

rluvaton force-pushed the lower-sample-count-sort branch from e335354 to a61af43 Compare July 14, 2026 15:11

rluvaton marked this pull request as draft July 14, 2026 16:20

Uh oh!

Conversation

rluvaton commented Jul 13, 2026

Which issue does this PR close?

Rationale for this change

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

Uh oh!

rluvaton commented Jul 13, 2026

Uh oh!

adriangbot commented Jul 13, 2026

Uh oh!

adriangbot commented Jul 14, 2026

Uh oh!

rluvaton commented Jul 14, 2026

Uh oh!

adriangbot commented Jul 14, 2026

Uh oh!

rluvaton commented Jul 14, 2026

Uh oh!

adriangbot commented Jul 14, 2026

Uh oh!

rluvaton commented Jul 14, 2026

Uh oh!

adriangbot commented Jul 14, 2026

Uh oh!

rluvaton commented Jul 14, 2026

Uh oh!

adriangbot commented Jul 14, 2026

Uh oh!

adriangbot commented Jul 14, 2026

Uh oh!

adriangbot commented Jul 14, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants